Computer configured to display multimedia content

ABSTRACT

A computer can comprise a housing, a microprocessor disposed within the housing, a display, and a communication interface communicatively coupled to the microprocessor. The computer can be configured, responsive to locating decodable indicia within content viewable on the display, to decode the decodable indicia to produce at least one decoded message. The computer can be further configured to display the content with decoded message data being embedded into the content. The decoded message data can be provided by at least one decoded message, data derived from the decoded message.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims the benefit of U.S. patent applicationSer. No. 15/092,963 for a Computer Configured to Display MultimediaContent filed Apr. 7, 2016 (and published Oct. 6, 2016 as U.S. PatentPublication No. 2016/0292485), now U.S. Pat. No. 9,754,147, which claimsthe benefit of U.S. patent application Ser. No. 14/605,222 for aComputer Configured to Display Multimedia Content filed Jan. 26, 2015(and published Jun. 18, 2015 as U.S. Patent Publication No.2015/0169929), now U.S. Pat. No. 9,311,516, which claims the benefit ofU.S. patent application Ser. No. 13/538,163 for a Computer Configured toDisplay Multimedia Content filed Jun. 29, 2012 (and published Jan. 2,2014 as U.S. Patent Application Publication No. 2014/0001254), now U.S.Pat. No. 8,944,313. Each of the foregoing patent applications, patentpublications, and patents is hereby incorporated by reference in itsentirety.

FIELD OF THE INVENTION

The present invention relates generally to computers, and in particularto computers configured to display multimedia content.

BACKGROUND

Computers equipped with displays (including mobile communicationterminals such as smartphones, mobile phones, personal digitalassistants, etc.) are widely used for displaying multimedia content,including still images, video streams, document files, etc. Thedisplayed multimedia content can comprise images of optical decodableindicia, e.g., bar codes.

SUMMARY

In one embodiment, there is provided a computer comprising a housing, amicroprocessor disposed within the housing, a display, and acommunication interface communicatively coupled to the microprocessor.The computer can be configured, responsive to locating decodable indiciawithin content viewable on the display, to decode the decodable indiciato produce at least one decoded message. The computer can be furtherconfigured to display the content with decoded message data beingembedded into the content. The decoded message data can be provided by adecoded message and/or data derived from the decoded message.

In a further aspect, the content can be provided by a video stream, animage file, and/or a document file.

In a further aspect, the computer can be further configured to derivethe decoded message data from the decoded message by dereferencing areference comprised by the decoded message.

In a further aspect, the computer can be further configured to displaythe decoded message data responsive to a user interface action receivedwhile the content is being displayed.

In a further aspect, the computer can be further configured to locatethe decodable indicia within the content responsive to receiving a bytestream representing the content via the communication interface.

In a further aspect, the computer can be further configured to displaythe content responsive to a user interface action.

In a further aspect, the computer can be further configured to decodethe decodable indicia by transmitting at least part of the content to anexternal computer for decoding.

In some embodiments, the computer can further comprise an encodedinformation reading (EIR) device provided by a bar code reading device,an RFID reading device, or a card reading device. In a further aspect,the EIR device can be configured to perform output raw message datacontaining an encoded message and/or output decoded message datacorresponding to an encoded message.

In a further aspect, the computer can be provided by a smart phone, amobile phone, a personal digital assistant (PDA), or an EIR terminal.

In a further aspect, the communication interface can be provided by awireless communication interface.

In another embodiment, there is provided a method of displaying contentcomprising one or more images of decodable indicia by a computer. Themethod can comprise the steps of locating decodable indicia withincontent viewable on the display, decoding the decodable indicia toproduce at least one decoded message, and displaying the content withdecoded message data being embedded into the content. The decodedmessage data can be provided by at least one decoded message and/or dataderived from the decoded message.

In a further aspect, the content can be provided a video stream, animage file, and/or a document file.

In a further aspect, the decoded message data can be derived from thedecoded message by dereferencing a reference comprised by the decodedmessage.

In a further aspect, the step of embedding the decoded message data cancomprise visually embedding the decoded message data into the content.

In a further aspect, the decoded message data can be viewable responsiveto a user interface action.

In a further aspect, the step of locating the decodable indicia can beperformed responsive to receiving a byte stream representing the contentvia the communication interface.

In a further aspect, the step of displaying the content can be performedresponsive to a user interface action.

In a further aspect, the step of decoding the decodable indicia can beperformed by transmitting at least part of the content to an externalcomputer for decoding.

In a yet another embodiment, there is provided a data decoding systemcomprising a client computer and one or more servers communicativelycoupled to a network. The servers can execute at least one decodingprocess. The client computer can be configured, responsive to locatingdecodable indicia within content viewable on the display, to transmit toat least one server a decoding request comprising at least part of thecontent. The decoding process can be configured, responsive to receivingthe decoding request, to decode the decodable indicia into at least onedecoded message. The decoding process can be further configured,responsive to completing a decoding operation, to transmit at least onedecoded message and/or a decoding operation completion code to theclient computer. The client computer can be further configured todisplay the content with decoded message data being embedded into thecontent. The decoded message data can be provided by at least onedecoded message and/or data derived from the decoded message.

In a further aspect, the content can be provided a video stream, animage file, and/or a document file.

In a further aspect, the decoded message data can be derived from thedecoded message by dereferencing a reference comprised by the decodedmessage.

In a further aspect, the client computer can be further configured tovisually embed the decoded message data into the content.

In a further aspect, the client computer can be further configured todisplay the decoded message data responsive to a user interface actionreceived while the content can be displayed.

In a further aspect, the client computer can be further configured todisplay the content responsive to a user interface action.

In some embodiments, the client computer can comprise an encodedinformation reading (EIR) device provided by a bar code reading device,an RFID reading device, or a card reading device. In a further aspect,the EIR device can be configured to output raw message data containingan encoded message and/or output decoded message data corresponding toan encoded message.

BRIEF DESCRIPTION OF THE DRAWINGS

For the purpose of illustrating the invention, the drawings show aspectsof one or more embodiments of the invention. However, it should beunderstood that the present invention is not limited to the precisearrangements and instrumentalities shown in the drawings, wherein:

FIGS. 1a-1c schematically illustrate one embodiment of a mobilecommunication terminal described herein;

FIG. 2 depicts a component-level layout of a computer described herein;

FIGS. 3a-3c illustrate various methods of visually embedding decodedmessage data into multimedia content to be displayed;

FIGS. 4a-4b illustrate flowcharts of various illustrative embodiments ofa method of displaying content comprising one or more images ofdecodable indicia;

FIG. 5 schematically illustrates a component diagram of one embodimentof a data decoding system;

FIG. 6 depicts a flowchart of one embodiment of a method of decodableindicia decoding by the data decoding system.

The drawings are not necessarily to scale, emphasis instead generallybeing placed upon illustrating the principles of the invention. In thedrawings, like numerals are used to indicate like parts throughout thevarious views.

DETAILED DESCRIPTION

A “communication network” or “network” herein shall refer to a set ofhardware and software components implementing a plurality ofcommunication channels between two or more computers. A network can beprovided, e.g., by a local area network (LAN), or a wide area network(WAN). While different networks can be designated herein, it isrecognized that a single network as seen from the network layer of theOSI model can comprise a plurality of lower layer networks, i.e., whatcan be regarded as a single Internet Protocol (IP) network, can includea plurality of different physical networks.

A “computer” herein shall refer to a programmable device for dataprocessing, including a central processing unit (CPU), a memory, and atleast one communication interface. For example, in one embodiment, acomputer can be provided by an Intel-based server running Linuxoperating system. In another embodiment, a computer can be provided by avirtual server, i.e., an isolated instance of a guest operating systemrunning within a host operating system. In a yet another embodiment, acomputer can be provided by a mobile communication terminal. In a yetanother embodiment, a computer can be provided by an encoded informationreading (EIR) terminal. In a yet another embodiment, a computer can beprovided by a personal digital assistant (PDA). In a yet anotherembodiment, a computer can be provided by a smartphone.

A “message” herein shall refer to a byte sequence or a character stringcomprising alphanumeric and/or non-alphanumeric characters.

A “process” herein shall refer to an instance of a computer program thatis being executed; in some operating systems, several processes can beinstantiated simultaneously. In some operating systems, severalprocesses can be executed concurrently. In some operating systems,several processes can be instantiated simultaneously from the samecomputer program.

In one embodiment, there is provided a computer equipped with a display.The computer can be used for displaying multimedia content, includingstill images, video streams, document files, etc. The content can bedownloaded by the computer via a wired or wireless communicationinterface. Alternatively, the computer can employ its imaging device toacquire moving or still images. The computer can store the downloaded oracquired content in its memory and/or display the content on itsdisplay.

Multimedia content displayed by the computer described herein cancontain images of optical decodable indicia, e.g., bar codes. To enhancethe user's viewing experience, the computer described herein can beadapted to decode the decodable indicia and visually embed the decodedmessage or data derived from the decoded message into the multimediacontent being displayed. For example, the decoded message or the dataderived from the decoded message can be overlaid over the image of thecorresponding decodable indicia. In another example, the decoded messagecan be displayed within a tooltip associated with a screen pointer(e.g., a cursor) responsive to the user's hovering the pointer over theimage of the decodable indicia.

In a further aspect, the computer described herein can be adapted toimprove the user's viewing experience by locating images of decodableindicia within the content and decoding the decodable indicia ahead ofthe time the content is displayed.

In a further aspect, the computer can transmit images of decodableindicia to a decoding server for decoding. This can be particularlyuseful in situations when the computer (e.g., a mobile communicationterminal) lacks the processing resources needed to simultaneouslydisplay multimedia content and perform decodable indicia decoding. Inanother illustrative example, the computer can lack one or more softwaremodules implementing methods needed to decode a particular type ofdecodable indicia. Alternatively, the computer described herein canperform the decoding locally.

Hence, in one embodiment, there is provided an optical indicia decodingsystem comprising an imaging client computer (provided, e.g., by amobile communication terminal) and one or more decoding server computerscommunicatively coupled to a communication network. The decoding servercomputers can execute one or more decoding processes.

The imaging client can locate decodable indicia within the contentviewable on the display and to transmit to a decoding server a decodingrequest comprising at least part of the content. The decoding server,responsive to receiving the decoding request, can decode the decodableindicia into one or more decoded messages and transmit the decodingresult to the imaging client. The imaging client can be furtherconfigured to visually embed the decoded message or data derived fromthe decoded message into the multimedia content and display themultimedia content, e.g., responsive to a user interface action.

As noted herein supra, in some embodiments, the computer describedherein can be provided by a mobile communication terminal. Oneembodiment of the mobile communication terminal is shown in FIGS. 1a(front panel view), 1 b (side panel view), and 1 c (bottom panel view).The mobile communication terminal 100 can comprise a housing 52 withinwhich other components of mobile communication terminal 100 can bedisposed. A display 54 can be embedded into housing 52 and disposed onthe front panel 56. Also disposed on the front panel 56 can be a decodeLED 58, a scan LED 62, and a keyboard 64 including a scan key 68 andnavigation keys 72. An imaging window 74 can be disposed on the toppanel of the housing 52. Disposed on the side panel (best viewed in FIG.1b ) can be an infra-red communication port 76, an access door to asecure digital (SD) memory interface 78, an audio jack 80, and a handstrap 82. Disposed on the bottom panel (best viewed in FIG. 1c ) can bea multi-pin mechanical connector 84 and a hand strap clip 86. A skilledartisan would appreciate the fact that other types and form factors ofmobile communication terminal housings are within the scope of thisdisclosure.

FIG. 2 depicts a component-level diagram of one embodiment of a computerdescribed herein. The computer 100 can comprise at least onemicroprocessor 310 and a memory 320, both coupled to the system bus 370.The microprocessor 310 can be provided by a general purposemicroprocessor or by a specialized microprocessor (e.g., an ASIC). Inone embodiment, computer 100 can comprise a single microprocessor whichcan be referred to as a central processing unit (CPU). In anotherembodiment, computer 100 can comprise two or more microprocessors. Askilled artisan would appreciate the fact that various schemes ofprocessing tasks distribution among two or more microprocessors arewithin the scope of this disclosure.

Computer 100 can further comprise a communication interface 340communicatively coupled to the system bus 370. In one embodiment, thecommunication interface can be provided by a wireless communicationinterface. The wireless communication interface can be configured tosupport, for example, but not limited to, the following protocols: atleast one protocol of the IEEE 802.11/802.15/802.16 protocol family, atleast one protocol of the HSPA/GSM/GPRS/EDGE protocol family, TDMAprotocol, UMTS protocol, LTE protocol, and/or at least one protocol ofthe CDMA/1×EV-DO protocol family. In a further aspect, the communicationinterface can be at least partially disposed within housing 52. In someembodiments, wireless communication interface can comprise an antennawhich can at least partially be disposed outside of housing 52.

Computer 100 can further comprise an imaging device 330, provided, forexample, by a two-dimensional imager. In some embodiments, a computer100 can further comprise a graphical user interface including a displayadapter 175 and a keyboard 179. In some embodiments, a computer 100 canfurther comprise an audio output device, e.g., a speaker 181.

In some embodiments, computer 100 can further comprise an EIR device333. The EIR device can be provided, for example, by a bar code readingdevice, an RFID reading device, and/or a card reading device. The EIRdevice can be configured to output raw message data containing anencoded message and/or output decoded message data corresponding to anencoded message. An encoded message can be used to convey information,such as identification of the source and the model of an item, forexample, in a UPC code.

As noted herein supra, in some embodiments, computer 100 can be providedby a mobile communication terminal. Mobile embodiments of computer 100can comprise a battery 356. In one embodiment, the battery 356 can beprovided by a replaceable rechargeable battery pack. Computer 100 canfurther comprise a GPS receiver 380. Computer 100 can further compriseat least one connector 390 configured to receive a subscriber identitymodule (SIM) card.

As noted herein supra, computer 100 can in one embodiment be configuredto download multimedia content containing images of decodable indicia.In some embodiments, computer 100 can employ its imaging device toacquire multimedia content provided by still images and/or videostreams. Computer 100 can be further configured to store in its memorythe content downloaded via communication interface 340 or acquired usingimaging device 330.

Computer 100 can be further configured to locate the decodable indiciacontained within the content and produce a decoded message by decodingthe decodable indicia either locally or by transmitting a decodingrequest to an external decoding server. In one embodiment, computer 100can perform locating and decoding operations responsive to downloadingor acquiring multimedia content. In another embodiment, computer 100 canperform locating and decoding operations within the multimedia contentbeing downloaded or acquired via the imaging device. In a yet anotherembodiment, computer 100 can perform locating and decoding operationsresponsive to receiving a user interface action, e.g., a graphical userinterface (GUI) command to display multimedia content. In a yet anotherembodiment, computer 100 can look ahead and locate decodable indiciawithin the multimedia content being displayed.

The decoding operation result can comprise the decoding operationcompletion code and/or the decoded message. The decoding operationcompletion code can indicate whether the decoding operation wassuccessful or unsuccessful, and in the latter case can further indicateone or more reasons of unsuccessful decoding attempt, e.g., failure tolocate decodable indicia, unknown symbology, etc.

Computer 100 can be further configured to display the content responsiveto a user interface action or another event (e.g., responsive toacquiring a still image or a video stream). Computer 100 can be furtherconfigured to visually embed the decoded message and/or data derivedfrom the decoded message into the multimedia content to be displayed. Inone example, the decoded message can be visually overlaid over the imageof the corresponding decodable indicia, as schematically shown in FIG.3a . In another example, schematically illustrated in FIG. 3b , thedecoded message can be displayed within a tooltip associated with ascreen pointer (e.g., a cursor) responsive to a pre-determined GUI event(e.g., MouseOver event raised responsive to the user's hovering thescreen pointer over an image of the decodable indicia) received whilethe content containing the decodable indicia is being displayed. In ayet another example, responsive to a pre-determined GUI event, thedecoded message can be displayed within a status bar or other designatedarea of the display, as schematically shown in FIG. 3 c.

In some embodiments, the decoded message can contain a reference tocontent that can be retrieved by the computer 100. For example, thedecoded message can contain a uniform resource locator (URL) identifyinga resource (e.g., an HTML file) accessible by computer 100 via theInternet. In another example, the decoded message can contain a UPCcode, and the corresponding product description can be retrieved bycomputer 100 from an embedded or external database. Computer 100 can beconfigured to derive the decoded message data from the decoded messageby dereferencing a reference comprised by the decoded message, and tovisually embed the data derived from the decoded message (e.g., at leastpart of the content referenced by the decoded message) into themultimedia content to be displayed. As an example of this, if thedecoded message data was a URL, the dereferencing of it may be loading athumbnail of the webpage referenced by the URL. Another example might bethat the decoded message is the UPC code of a particular product, anddereferencing may be loading a thumbnail of a website describing theproduct or doing a price check on it.

One illustrative embodiment of a method of displaying content comprisingone or more images of decodable indicia is now being described withreferences to the flowchart of FIG. 4 a.

Processing commences by the computer receiving, at step 4010, a bytestream representing multimedia content including still images, videostreams, document files, etc. In one embodiment, the computer candownload the multimedia content over a communication interface.Alternatively, the computer can employ its imaging device to acquiremultimedia content including still images and/or video streams. Thereceived multimedia content can be stored in the memory of the computer.

At step 4020, the computer can locate one or more decodable indiciawithin the multimedia content. In one embodiment, the computer caninitiate locating operations responsive to downloading or acquiringmultimedia content. In another embodiment, the computer can initiatelocating operations within the multimedia content being downloaded oracquired via the imaging device. In a yet another embodiment, thecomputer can initiate locating operations responsive to receiving a userinterface action (e.g., a GUI command to display multimedia content). Ina yet another embodiment, the computer can look ahead and locatedecodable indicia within the multimedia content being displayed.

At step 4030, the computer can transmit a decoding request comprisingone or more images of decodable indicia to an external server fordecoding.

Upon receiving a decoding result within the communication interfaceinput loop 4040-4050, the computer can continue processing at step 4070.The decoding result can comprise the decoding operation completion codeand/or the decoded message.

At step 4070, the computer can embed into the multimedia content thedecoded message data provided by the decoded message and/or data derivedfrom the decoded message, as described in details herein supra.

Responsive to receiving, within the GUI input loop 4080-4110, a GUIcommand to start displaying the multimedia content, the computer can, atstep 4130, start displaying the content.

Responsive to receiving, within the GUI input loop 4080-4110, aMouseOver GUI event raised responsive to the user's hovering the screenpointer over an image of decodable indicia, the computer can, at step4140, display the decoded message data provided by the decoded messageand/or data derived from the decoded message within a tooltip associatedwith the screen pointer.

Responsive to receiving, within the GUI input loop 4080-4110, a GUIcommand to stop displaying the multimedia content, the computer can, atstep 4150, stop displaying the multimedia content.

Either waiting for a decoding result during the Network Input loop4040-4050 or responsive to receiving, within the GUI input loop4080-4110, a GUI command not identified above, the computer can, at step4160, process the received command, or perform other processing asnecessary.

Responsive to establishing at step 4170 that the multimedia content hasbeen fully displayed, the processing can terminate.

Another illustrative embodiment of a method of displaying contentcomprising one or more images of decodable indicia is now beingdescribed with references to the flowchart of FIG. 4 b.

Processing commences by the computer receiving, at step 4210, a bytestream representing multimedia content including still images, videostreams, document files, etc. In one embodiment, the computer candownload the multimedia content over a communication interface.Alternatively, the computer can employ its imaging device to acquiremultimedia content including still images and/or video streams. Thereceived multimedia content can be stored in the memory of the computer.

At step 4220, the computer can locate one or more decodable indiciawithin the multimedia content. In one embodiment, the computer caninitiate locating operations responsive to downloading or acquiringmultimedia content. In another embodiment, the computer can initiatelocating operations within the multimedia content being downloaded oracquired via the imaging device. In a yet another embodiment, thecomputer can initiate locating operations responsive to receiving a userinterface action (e.g., a GUI command to display multimedia content). Ina yet another embodiment, the computer can look ahead and locatedecodable indicia within the multimedia content being displayed.

At step 4230, the computer can decode the decodable indicia to produce adecoding result comprising the decoding operation completion code and/orthe decoded message.

At step 4240, the computer can embed into the multimedia content thedecoded message data provided by the decoded message and/or data derivedfrom the decoded message, as described in details herein supra.

Responsive to receiving, within the GUI input loop 4250-4280, a GUIcommand to start displaying the multimedia content, the computer can, atstep 4300, start displaying the content.

Responsive to receiving, within the GUI input loop 4250-4280, aMouseOver GUI event raised responsive to the user's hovering the screenpointer over an image of decodable indicia, the computer can, at step4310, display the decoded message data provided by the decoded messageand/or data derived from the decoded message within a tooltip associatedwith the screen pointer.

Responsive to receiving, within the GUI input loop 4250-4280, a GUIcommand to stop displaying the multimedia content, the computer can, atstep 4320, stop displaying the multimedia content.

Responsive to receiving, within the GUI input loop 4250-4280, a GUIcommand not identified above, the computer can, at step 4330, processthe received command, or perform other processing as necessary.

Responsive to establishing at step 4340 that the multimedia content hasbeen fully displayed, the processing can terminate.

The above described method of displaying content comprising one or moreimages of decodable indicia can, in one embodiment, be implementedwithin a plug-in for a content viewing program, such as an Internetbrowser. In another embodiment, the above described method can beimplemented as an integral part of a content viewing program. A skilledartisan would appreciate the fact that various implementations of theabove described method are within the scope of this disclosure.

FIG. 5 schematically illustrates one embodiment of a decoding systemdescribed herein. The decoding system 1000 can comprise a plurality ofdecoding servers 120 a-120 z communicatively coupled to a network 110 a.Network 110 a can be provided, e.g., by Ethernet-based local areanetwork, and can be communicatively coupled to the Internet 170 via oneor more routers 130 a and/or one or more networks 110 b. An imagingclient 101 a can be provided, e.g., by a mobile communication terminalcommunicatively coupled to a local area network 110 m via a wirelessaccess point 140. Network 110 m can be communicatively coupled to theInternet 170 via one or more routers 130 m and/or one or more networks110 t. An imaging client 101 b can be provided by an EIR terminalmounted into a POS workstation and can be communicatively coupled to thelocal area network 110 m via an Ethernet communication interface. Animaging client 101 c can be provided by a smart phone communicativelycoupled to a provider's network 110 r via a GSM/GPRS base station 145.Network 110 r can be communicatively coupled to the Internet 170 via oneor more routers 130 r and/or one or more networks 110 s.

In one embodiment, the decoding system 1000 can follow a cloud computingmodel, by providing an on-demand network access to a shared pool ofconfigurable computing resources (e.g., servers, storage, applications,and/or services) that can be rapidly provisioned and released withminimal or no resource management effort, including interaction with theservice provider, by the consumer (operator of a thin client). Onecharacteristic of the cloud computing model is that a consumer canunilaterally provision computing capabilities, such as CPU power andstorage capacity on the network, as needed automatically withoutrequiring human interaction with the service's provider. The resourcesof the cloud can be accessed by thin clients over a network.

In another aspect, imaging clients can access cloud-based decodingapplications executed by computers 120 a-120 z via a single point ofentry, e.g., via a single IP address or uniform resource identifier(URI). In one embodiment, the single point of entry IP address can beassigned to a load balancing component provided, e.g., by router 130 aor by a dedicated load balancer 120 r. In another embodiment, the singlepoint of entry URI can include a fully-qualified host name resolvable bya DNS server into one or more IP addresses of computers 120 a-120 z. Ina yet another embodiment, the single point of entry URI can include afully-qualified host name resolvable by a DNS server into an IP addressof the dedicated load balancer 120 r which can act as a server-side HTTPproxy by forwarding HTTP requests from the imaging clients 101 a-101 cto HTTP processes running on the decoding computers 120 a-120 z. Theserver-side HTTP proxy can preserve HTTP or application-level sessionsby forwarding all TCP packets from one client to the same server. Thus,an imaging client accessing the cloud-based decoding applications can beagnostic with respect to the number of computers 120 a-120 z, topologyof the local area networks 110 a-110 b, aspects of load balancing amongthe computers 120 a-120 z and other server-side implementation details.

For preventing unauthorized access to the cloud-based decoding services,decoding system 1000 can require an imaging client to be authenticatedbefore processing any decoding requests.

In a further aspect, a decoding process can, responsive to completing adecoding operation, transmit the decoding operation result includingdecoded message data and/or the decoding operation completion code tothe imaging client. The decoding operation completion code can, in oneembodiment, contain a flag indicating whether the decoding operation wassuccessful. In another embodiment, the decoding operation completioncode can contain the number of decoding attempts performed. In a yetanother embodiment, the decoding operation completion code can containan extended error code indicating the reason for the decoding operationfailure, for example, failed to locate decodable indicia, decodableindicia symbol truncated, insufficient image resolution, etc.

In another aspect, the imaging client can be provided by a large varietyof imaging devices. In one embodiment, the imaging client can beprovided by a mobile computing device (e.g., a smartphone or an encodedinformation reading (EIR) terminal) comprising an integrated imagingdevice or a peripheral imaging device. An integrated imaging device canbe provided, e.g., by a two-dimensional imager incorporated into thehousing of the mobile computing device and communicatively coupled toother components of the mobile computing device, including, e.g., a databus, a processor, or a communication interface. A peripheral imagingdevice can be provided, e.g., by a still image or video camera disposedin a separate housing and communicatively coupled to the mobilecomputing device (e.g., via Bluetooth interface).

In another embodiment, the imaging client can be provided by a generalpurpose computing device (e.g., a notebook computer or a desktopcomputer) comprising an integrated imaging device or a peripheralimaging device. In a yet another embodiment, the imaging client can beprovided by a computing device by a computing device integrated into aPOS system (e.g., a retail cashier's workstation) comprising anintegrated imaging device or a peripheral imaging device.

FIG. 6 depicts a flowchart of one embodiment of a method of decodableindicia decoding by the above described data decoding system.

At step 610, an imaging client can acquire an image containing decodableindicia.

At step 620, the imaging client can pre-process the acquired image. Inone embodiment, the pre-processing can comprise filtering images basedon the image quality, as described in details herein supra. In anotherembodiment, the pre-processing can include scaling the acquired image,as described in details herein supra. In a further aspect, thepre-processing parameters can be dynamically adjusted based on one ormore decoding operation completion codes received by the imaging clientfrom a decoding server.

At step 630, the imaging client can transmit the pre-processed image toa decoding server over a communication network.

At steps 640-650, responsive to receiving the image, the decoding servercan locate and decode the decodable indicia.

At step 660, the decoding server can transmit the decoding result to theimaging client over a communication network. In one embodiment, thedecoding result can include one or more decoded messages and/or one ormore decoding operation completion codes. The decoding operationcompletion code can contain a flag indicating whether the decodingoperation was successful. In one embodiment, the decoding operationcompletion code can contain an extended error code indicating the reasonfor the decoding operation failure, for example, failed to locatedecodable indicia, decodable indicia symbol truncated, insufficientimage resolution, etc.

At steps 670-680, responsive to receiving the decoding result theimaging client can process the result, e.g., by displaying the decodedmessage and/or transmitting the decoded message to an external computer(e.g., transmitting a retail item identifier to a store server toretrieve the product information). After processing the decoding resultat step 4080, the method can terminate.

While the present invention has been particularly shown and describedwith reference to certain exemplary embodiments, it will be understoodby one skilled in the art that various changes in detail may be affectedtherein without departing from the spirit and scope of the invention asdefined by claims that can be supported by the written description anddrawings. Further, where exemplary embodiments are described withreference to a certain number of elements it will be understood that theexemplary embodiments can be practiced utilizing less than the certainnumber of elements.

A small sample of systems, methods, and apparata that are describedherein is as follows:

A1. A computer comprising:

a housing;

a microprocessor disposed within said housing;

a display;

a communication interface communicatively coupled to saidmicroprocessor, said communication interface at least partially disposedwithin said housing;

wherein said computer is configured, responsive to locating decodableindicia within content viewable on said display, to decode saiddecodable indicia to produce at least one decoded message;

wherein said computer is further configured to display said content withdecoded message data being embedded into said content;

wherein said decoded message data is provided by at least one of: saidat least one decoded message, data derived from said at least onedecoded message.

A2. The computer of (A1), wherein said content is provided by at leastone of: a video stream, an image file, a document file.

A3. The computer of (A1), further configured to derive said decodedmessage data from said at least one decoded message by dereferencing areference comprised by said decoded message.

A4. The computer of (A1), further configured to display said decodedmessage data responsive to a user interface action received while saidcontent is being displayed.

A5. The computer of (A1), further configured to locate said decodableindicia within said content responsive to receiving a byte streamrepresenting said content via said communication interface.

A6. The computer of (A1), further configured to display said contentresponsive to a user interface action.

A7. The computer of (A1), further configured to decode said decodableindicia by transmitting at least part of said content to an externalcomputer for decoding.

A8. The computer of (A1), further comprising an encoded informationreading (EIR) device selected from the group consisting of: a bar codereading device, an RFID reading device, and a card reading device;

wherein said EIR device is configured to perform at least one of:outputting raw message data containing an encoded message and outputtingdecoded message data corresponding to an encoded message.

A9. The computer of (A1), wherein said computer is provided by one of: aPersonal Computer, a Macintosh, an EIR terminal, a smart phone, a mobilephone, and a personal digital assistant (PDA).

A10. The computer of (A1), wherein said communication interface isprovided by a wireless communication interface.

B1. A method of displaying content comprising one or more images ofdecodable indicia by a computer, said method comprising the steps of:

locating decodable indicia within content viewable on said display;

decoding said decodable indicia to produce at least one decoded message;and

displaying said content with decoded message data being embedded intosaid content;

wherein said decoded message data is provided by at least one of: saidat least one decoded message, data derived from said at least onedecoded message.

B2. The method of (B1), wherein said content is provided by at least oneof: a video stream, an image file, a document file.

B3. The method of (B1), wherein said decoded message data is derivedfrom said at least one decoded message by dereferencing a referencecomprised by said decoded message.

B4. The method of (B1), wherein said step of embedding said decodedmessage data comprises visually embedding said decoded message data intosaid content.

B5. The method of (B1), wherein said decoded message data is viewableresponsive to a user interface action.

B6. The method of (B1), wherein said step of locating said decodableindicia is performed responsive to receiving a byte stream representingsaid content via said communication interface.

B7. The method of (B1), wherein said step of displaying said content isperformed responsive to a user interface action.

B8. The method of (B1), wherein said step of decoding said decodableindicia is performed by transmitting at least part of said content to anexternal computer for decoding.

C1. A data decoding system comprising a client computer and one or moreserver computers communicatively coupled to a network, said one or moreserver computers executing at least one decoding process;

wherein said client computer is configured, responsive to locatingdecodable indicia within content viewable on said display, to transmit adecoding request comprising at least part of said content to said one ormore servers;

wherein said at least one decoding process is configured, responsive toreceiving said decoding request, to decode said decodable indicia intoat least one decoded message;

wherein said at least one decoding process is further configured,responsive to completing a decoding operation, to transmit at least oneof: said at least one decoded message, a decoding operation completioncode to said client computer;

wherein said client computer is further configured to display saidcontent with decoded message data being embedded into said content; and

wherein said decoded message data is provided by at least one of: saidat least one decoded message, data derived from said at least onedecoded message.

C2. The data decoding system of (C1), wherein said content is providedby at least one of: a video stream, an image file, a document file.

C3. The data decoding system of (C1), wherein said client computer isconfigured to derive said decoded message data from said at least onedecoded message by dereferencing a reference comprised by said decodedmessage.

C4. The data decoding system of (C1), wherein said client computer isfurther configured to visually embed said decoded message data into saidcontent.

C5. The data decoding system of (C1), wherein said client computer isfurther configured to display said decoded message data responsive to auser interface action received while said content is displayed.

C6. The data decoding system of (C1), wherein said client computer isfurther configured to display said content responsive to a userinterface action.

C7. The data decoding system of (C1), wherein said client computercomprises an encoded information reading (EIR) device selected from thegroup consisting of: a bar code reading device, an RFID reading device,and a card reading device;

wherein said EIR device is configured to perform at least one of:outputting raw message data containing an encoded message and outputtingdecoded message data corresponding to an encoded message.

1.-22. (canceled)
 23. An apparatus comprising: at least one processorand at least one memory, the at least one memory having computer-codedinstructions therein, the computer-coded instructions configured to, inexecution with the at least one processor, cause the apparatus to:analyze at least one frame from a stream of content to identify at leastone decodable indicia; decode the at least one decodable indicia toproduce at least one decoded message; generate a displayable contentoverlay that is derived from the at least one decoded message, whereinthe displayable content overlay comprises at least one of the decodedmessage, data derived from the at least one decoded message, and a flagindicating whether the decode was successful; and display thedisplayable content overlay.
 24. The apparatus of claim 23, wherein thecomputer-coded instructions are configured to, in execution with the atleast one processor, further cause the apparatus to display thedisplayable content overlay to be displayed in response to a useraction.
 25. The apparatus of claim 23, wherein the computer-codedinstructions are configured to, in execution with the at least oneprocessor, further cause the apparatus to: display a selector overlay;and receive an indication that the selector overlay hovered over the atleast one decodable indicia for a predetermined period; wherein the atleast one decodable indicia is decoded to produce the at least onedecoded message is decoded in response to the indication.
 26. Theapparatus of claim 25, wherein the computer-coded instructions areconfigured to, in execution with the at least one processor, furthercause the apparatus to: remove the selector overlay in response to thedisplay of the displayable content overlay.
 27. The apparatus of claim25, wherein the selector overlay is a defined area that is displayableon the display.
 28. The apparatus of claim 23, wherein thecomputer-coded instructions are configured to, in execution with the atleast one processor, further cause the apparatus to display thedisplayable content overlay with the stream of content, wherein thedisplayable content overlay is visually embedded in the stream ofcontent.
 29. The apparatus of claim 23, wherein the computer-codedinstructions are configured to, in execution with the at least oneprocessor, further cause the apparatus to: display an acquired stream ofcontent; and in response to the at least one decodable indicia beingdecoded to produce the at least one decoded message; replace theacquired stream of content with the displayable content overlay.
 30. Theapparatus of claim 23, wherein the stream of content is received from animage sensor.
 31. The apparatus of claim 23, wherein the displayablecontent overlay comprises the decoded message, wherein the at least onedecodable indicia is a bar code, and the at least one decoded message isrepresentative of an item.
 32. A method comprising: analyzing, using aprocessor, at least one frame from a stream of content to identify atleast one decodable indicia; decoding the at least one decodable indiciato produce at least one decoded message; generating a displayablecontent overlay that is derived from the at least one decoded message,wherein the displayable content overlay comprises at least one of thedecoded message, data derived from the at least one decoded message, anda flag indicating whether the decode was successful; and causing thedisplayable content overlay to be displayed.
 33. The method of claim 32,further comprising wherein the displayable content overlay is caused tobe displayed in response to a user action.
 34. The method of claim 32,further comprising: causing a selector overlay to be displayed; andreceiving an indication that the selector overlay is placed over the atleast one decodable indicia for a predetermined period; wherein the atleast one decodable indicia is decoded to produce the at least onedecoded message is decoded in response to the indication.
 35. The methodof claim 34, further comprising: removing the selector overlay inresponse to the display of the displayable content overlay.
 36. Themethod of claim 34, wherein the selector overlay is a defined area thatis displayable on the display.
 37. The method of claim 32, furthercomprising causing the displayable content overlay to be displayed withthe stream of content, wherein the displayable content overlay isvisually embedded in the stream of content.
 38. The method of claim 32,further comprising: causing an acquired stream of content to bedisplayed; and in response to the at least one decodable indicia beingdecoded to produce the at least one decoded message; causing theacquired stream of content to be displayed with the displayable contentoverlay.
 39. The method of claim 32, wherein the stream of content isreceived from an image sensor.
 40. The method of claim 32, wherein thedisplayable content overlay comprises the decoded message, wherein theat least one decodable indicia is a bar code, and the at least onedecoded message is representative of an item.
 41. A method comprising:causing multimedia content to be displayed; analyzing, using aprocessor, at least one frame from a stream of received content toidentify at least one decodable indicia; decoding the at least onedecodable indicia to produce at least one decoded message; generating adisplayable content overlay that is derived from the at least onedecoded message, wherein the displayable content overlay comprises atleast one of the decoded message, data derived from the at least onedecoded message, and a flag indicating whether the decode wassuccessful; and causing the displayable content overlay to be displayed,wherein the displayable content overlay is visually embedded with themultimedia content or is displayed instead of the multimedia content.42. The method of claim 41, wherein the displayable content overlaycomprises the decoded message, wherein the at least one decodableindicia is a bar code, and the at least one decoded message isrepresentative of an item.